arXiv:1507.08082vl [cs.SY] 29 Jul 2015 


PointQ model of an arterial network: calibration and experiments* 


Fatma Yildiz Tascikaraoglu, Jennie Lioris, Ajith Muralidharan, Martin Gouy 

and Pravin Varaiya 

July 30, 2015 


Abstract 

The calibration of a PointQ arterial microsimulation model is formulated as a quadratic 
programming problem (QP) whose decision variables are link flows, demands at entry links, 
and turn movements at intersections, subject to linear constraints imposed by flow conservation 
identities and field measurements of a subset of link flows (counts), demands and turn ratios. 

The quadratic objective function is the deviation of the decision variables from their measured 
values. The solution to the QP gives estimates of all unmeasured variables and thus yields a fully 
specified simulation model. Runs of this simulation model can then be compared with other 
field measurements, such as travel times along routes, to judge the reliability of the calibrated 
model. A section of the Huntington-Colorado arterial near 1-210 in Los Angeles comprising 73 
links and 16 intersections is used to illustrate the procedure. Two experiments are conducted 
with the calibrated model to determine the maximum traffic that can be diverted from the 
1-210 freeway to the arterial network, with and without permitting changes in the timing plans. 

The maximum diversion in both cases is obtained by solving a linear programming problem. A 
third experiment compares the delay and travel time using the existing fixed time control and a 
max pressure control. The fourth experiment compares two PointQ models: in the first model 
the freeway traffic follows a pre-specified route while the background traffic moves according to 
turn ratios, and in the second model turn ratios are modified in a single-commodity model to 
match the link flows. The substantial modification of the turn ratios needed suggests that the 
use of a single-commodity model as frequently done in CTM models can be misleading. Often 
there are too few measurements to identify all the unmeasured link flows. A simple graphical 
condition is provided to check whether or not a particular unmeasured link flow can be identified 
from the measured flows. Another condition determines the additional measurements needed to 
identify all unmeasured flows. If not all flows can be identified, the magnitude of inaccuracy in 
terms of VMT is estimated as the solution to a linear programming problem. Lastly, analysis 
of congestion as the network loading is increased suggests a macroscopic queuing model of the 
network, which is compared with the macroscopic fundamental diagram. 

Keywords. PointQ simulator, microsimulation, calibration, freeway-arterial coordination, macro¬ 
scopic queueing model, macroscopic fundamental diagram. 
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1 Introduction 


Calibration of an arterial network model often requires estimating the parameters of a microsimu¬ 
lation model. The typical procedure is to simulate various combinations of model parameters and 
select that combination whose simulation results best match field measurements. One shortcoming 
of this approach is that the number of parameter combinations is huge whereas field data are too 
sparse to reliably distinguish between different parameter combinations. 


Suppose, following Park and Schneeberger (2004), that one elects to tune a 6-dimensional parameter 
vector 0 of a stochastic VISSIM model using field data of travel time measurements over a route. 
Stochastic runs of the simulation model generate samples from a random distribution f(0) of the 
travel time. Since f{0) is not explicitly known, it is impossible to estimate 6 E R 6 with any certainty 
even with several thousand field measurements of travel time. (If each parameter vector takes 8 
discrete values, 6 has 6 8 or 1.7M possible values.) Consequently, trust is eventually placed on how 
well the visualization of a small number of simulation runs confirms the analyst’s or client’s beliefs, 
rather than on any statistical measure of confidence. 


The second difficulty is that the parameters 6 of the VISSIM model such as ‘emergency stop 
distance’ and ‘lane change distance’ selected by Park and Schneeberger (2004), cannot be intuitively 
or theoretically related to the field data (travel time) so that one has no sound basis for specifying 
a parametric form for f{6) (Park and Schneeberger (2004) choose a linear function for /). 


The third difficulty is that the effort that goes into microsimulation calibration detracts from the 
goal of the simulation exercise which may be to design say a robust controller or to quickly evaluate 
a large number of tactical responses to incidents or events. 


The approach explored in this paper is different and more straightforward. It adopts a simple 
microsimulator, called PointQ (Lioris et al. (2014); Kouvelas et al. (2014)), which models the 
network of intersections as a queuing network. Vehicles arrive from outside the network at entry 
links in a deterministic or Poisson stream. They take a fixed or random time to travel along a 
link at the end of which they join a queue. Vehicles make turns at intersections either in fixed 
proportions or according to randomly selected O-D routes. PointQ is a discrete event simulator 
whose important events are associated with vehicle movement from a queue at one intersection to 
a queue at another intersection, and controller feedback actions that determine which phases are 
actuated. 


The output of PointQ is the record of all the events in the simulation run. The records are uploaded 
into a relational database. Responses to database queries yield network performance measures such 
as distribution of travel times along routes and vehicle-miles traveled (VMT), as well as intersection 
performance measures such as queuing delay, wasted green and progression quality. A visualization 
facility allows one to plot the performance measures as well as create an animation of the movement 
of vehicles through the network. 

Three sets of parameters specify a PointQ model: network geometry (link capacity and travel 
time or speed limit, turn pocket capacity, saturation flow rates for each phase); signal controller 
configuration; and specification of demand in terms of turn ratios or OD flows. The network and 
demand parameters (typically turn movement counts) are relatively easy to measure, the controller 
configuration is obtained from the local transportation agency. 


One advantage of PointQ over (say) VISSIM is that the underlying queuing network model provides 
a mathematical framework to analyze traffic movement (Muralidharan et al. (2014b)) and to design 
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signal control (Aboudolas et al. (2009); Varaiya ( 2013| )), so theoretical results based on simplified 
assumptions can be compared with more complex simulations. The computational advantage of 
PointQ is that like in ‘mesoscopic’ models such as Dynasmart (Jayakrishnan et al. (1994])), it 
does not use a driver model. Of course PointQ should not be used to study (say) the effect of 
driver aggression on safety or the impact of special roadway geometry. Further, its transparency 
makes it easy to spot PointQ model specification errors. Lastly, by increasing network loading, one 
can observe the onset of network congestion accompanied by a reduction in the exit flows. This 
prompts a formulation of network aggregate behavior as a macroscopic queuing model, which can 


be compared with the macroscopic fundamental diagram proposed by Geroliminis and D aganzo 
(2008). 


The rest of the paper is organized as follows, ^describes PointQ’s underlying queuing model. ^3] 
presents the flow constraints, and ®] formulates the calibration task as a quadratic programming 
problem, ^presents a calibration case study and ^describes experiments that motivated the case 
study. £[7] considers the situation in which there are too few measurements to identify all flows in 
the network, ^proposes a macroscopic queuing model, ^collects the conclusions. 


2 Model specification 

A PointQ arterial network model is specified by five data items: 

1. Network graph, link data: link storage capacity in number of vehicles (including turn pockets), 
link travel time (constant or stochastic), and possible movements (phases); 

2. Saturation flow rate for each movement at each intersection; 

3. Demand: external flows at each entry link; 

4. Routing: turn ratios for each movement at every signal and/or O-D routes; 

5. Specification of controller parameters at each signalized intersection, such as timing plan, 
offset, and cycle time for a fixed-time controller. 
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The calibration procedure assumes a network in ‘steady state’ described using the following nota¬ 
tion, which assumes a fixed time control. 


tall 

= 

set of all links, elements Z, m, k 

t [tentry i t ex it\ 

= 

set of internal [entry, exit] links 

Ini 

c 

L U Centry, set of links input to Z G L U C ex %t 

Outi 

c 

L U Cexit > set of links output from Z G L U C en try 

fi 

= 

flow of vehicles in link Z, vehicles per period 

di 

= 

exogenous flow of vehicles in link Z G C en try, vehicles per period 


= 

flow of vehicles making movement (Z,m), i.e. leaving Z and entering m, 
vehicles per period 

r(l, m) 

= 

fraction of flow fi leaving Z and entering m 

c(l, m) 

= 

saturation flow rate of phase (Z,m), vehicles per period 

gil.m) 

= 

actuation time of phase (Z, m) 

V 

= 

set of nodes or intersections, elements n 

/(n) 

c 

L U C en t ry , set of links entering n 

O(n) 

c 

L U C ex n, set of links leaving n 

Tn 

= 

cycle time of intersection n 

D,M,T 

= 

indexes of measured demands, flows, turn ratios 


3 Flow constraints 

Flow conservation 

Demand, routing and flow conservation impose constraints 


fi 

— dl, Z G Centry i 

(i) 


ii 

~s 

(2) 

fl 

— ^ ^ / (J 7 fri) 5 Z G L U Centry i 

m 

(3) 

fm 

— y ^ / (Z , TYl), 171 G t U Cexit • 

(4) 


l 


Eqs Q-Q imply flow conservation at node n\ number of vehicles entering and leaving n is the 
same: 


E /'= E fm, neM. (5) 

lEl(n) mCO(n) 

Example 1 Figure [l] shows a standard intersection with four approach and four departure di¬ 
rections. So there are in all 4 x 3 = 12 turn movements, if U-turns are forbidden. If there are 
TV intersections in the network, there are 127V flow or turn movements {/(Z,m)} in all, but only 
approximately 47V link flows {//}. So fewer measurements are needed to estimate all link flows 
than to estimate all turn movements. 
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Figure 1: Standard intersection with four approaches and four departures. 


Capacity constraint 

The number of vehicles /(Z,m) making movement (Z,m) is bounded by its capacity s(Z,m), which 
is the product of its saturation flow rate and the green time or actuation duration, 


f{l,m ) < s(l,m ) = g n ,i{^ m ) x c (^ m ); for a11 

n ieS n 


( 6 ) 


In ([6]), T n is the cycle time of the fixed-time controller at intersection n, S n is the set of stages at n, 
is the duration for which phase (Z,m) is actuated in stage z, and c(Z,m) is the saturation 
flow rate for phase (Z,m) at intersection n. Phase (Z,m) may be actuated in more than one stage 
i G S n , which accounts for the sum on the right. 


Stability 

PointQ is a discrete event simulation model of a continuous-time, delay-differential equation system 
that represents the traffic flow as a queuing network. It is shown in Muralidharan et al. (2014b) 
that ^ is necessary for the queueing network to be stable and if the inequality in ^ is strict, the 
condition is sufficient for stability. 


4 Calibration 

Suppose we have flow measurements (counts over say one hour) fi on links l G M, demands d[ at 
entry links l € D, and turn ratios r(l,m ) for movements (l,m) € T. (The ' accent as in fi denotes 
measured values.) To minimize the difference between the simulation values of the calibrated model 
and their measured values, we formulate a measurement equation: 

f t = j l + efl ,l€M, 
di = di + eat, l G D, 
f(l,m ) = r(l,m)fi + e f ^ m) , (l,m) € T, 
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in which the e^’s are measurement ‘errors’. The calibration problem is 


, ““ , J2 a l e fl 2 + J2 + J2 %m£f(l,m) 2 (10) 

1&M l£D {lm)( _ T 

s.t. 0 < /(Z,m) < s(Z,m), for all (Z,m), (11) 

fl = ^f(l,m) , / G L U Gentry •> ( 12 ) 

m 

/ m = ^/(l,m),meLU 

C'exit • (13) 

i 

and equality constraints 0 ,®,®. (14) 


The decision variables are /p dp /(/, m). The weights cq, /?/ and 7 on the errors reflect confidence 
in the accuracy of the measurements. This is a quadratic programming problem. All link and turn 
movement flows are taken as decision variables. The problem is feasible since the constraints are 
met with all decision variables equal to zero. 

Let /*, d*,/*(Z, ra) be an optimum solution. Define the calibrated split ratios, 


r*(Z, m) 


ft 


(15) 


Remark Suppose the measurements are error-free: all e & = 0. As noted in Example 1 , if there 
are N standard nodes there are 47V link flows and 127V turn movements. If we have too few 
measurements, the solution to the quadratic programming problem will not be unique, which 
means that the available measurements (even if error-free) are insufficient to uniquely identify all 
link flows and turn movements. This raises several questions that are addressed in ^7| Which flows 
are uniquely identified and which are not? Which additional measurements will make a particular 
flow or all flows identifiable? Can we bound their accuracy even if some flows cannot be identified? 


5 Case study 

We apply the calibration procedure to a section of the Huntington-Colorado arterial near 1-210 in 
Los Angeles. Figure [ 2 ] shows a map of the site and its abstraction as a directed graph with 16 
signalized intersections or nodes, 73 links, and 106 turn movements. This gives 179 flows in all. 
Flows in 30 links and 57 turn ratios are measured, many flows are unmeasured as is common in 
practice. 

The table in the Appendix gives the calibration results obtained by solving ([To])-([l4]). The table 
lists link IDs, measured flows {//}, and calculated flows {//} and the movements (from l to m) on 
the right hand side and the measured turn ratios (r(Z,m)} and calculated turn ratios {r(£, m)} on 
the left. Flows are in vehicles per hour (vph). For example, in link 200054 (abbreviated as link 254 
in Figure [ 2 ]) the measured flow is 1,016 vph while the optimization calculation yields 1,014 vph. 
Also, for movement (100037, 100054) both measured and calculated turn ratios equal 0.65. In the 
table an entry of ‘-1’ means that the corresponding measurement is not available. The table shows 
that the calibrated model calculations are close to measured values. The small errors are the result 
of (i) the relatively large number of unmeasured quantities, which make it easier to ‘fit’ the model 
0 -®, and (ii) consistency of the available measurements. 
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Figure 2: Map of site and corresponding network graph. Note: ID 105 means 10005. 


The quadratic program uses data for a single hour. Since the flows are considered to be constant 
during this period and the travel time across the network is much smaller than one hour, it is 
appropriate to assume the steady state model. If we have data for several time periods the exercise 
can be repeated and the mismatch between measured and simulated value should be small again. 
One may believe that the calibrated turn ratios r*(Z, m) should be the same if (say) measurements 
are made for the same hour over several days. We can attempt to enforce this by taking r*(Z,m) 
obtained from calibration for one day and use it as a ‘measured’ turn ratio r(Z,m) for other days. 
A more direct way would be to make r(Z,m) a variable and add the constraint: 

= r(l,m)fi, 

but this is a nonlinear constraint, and computationally more difficult to handle. 

We will refer to the calibrated demands, turn ratios and link flows in the Appendix as values of the 
baseline model. 


7 


































5.1 Simulation 


A PointQ model is specified by the five items listed at the beginning of ^2| The network graph 

Saturation flow rates (Item 2) are obtained 


is 


from high-resolution measurements as in Muralidharan et al. 

(2014a) or as default values from the 

Highway Capacity Manual ( 

Trasportation Research Board ( 

20io|j)7 as in the case study. Item 5 


is obtained from the traffic departments of cities sharing the arterial network. Some link flows, 
demands and turn ratios are obtained from special data collection efforts and from controller-based 
counts. Formulating and solving the calibration problem (10)-(14) yields the fully specified baseline 
model. We can now run that model and obtain performance measures for comparison with other 
field measurements (like route travel times) to validate or reject the model. We give four examples. 

Figure [3] displays the travel time of the 363 individual vehicles that enter the network at link 100053 
and leave it at link 100036 (see Figure [ 2 ] for the location of these links). The mean and standard 
deviation of these 363 travel times are 


/i 107s and a = 24s. 


(16) 


If for example we had travel time measurements using (say) Bluetooth readers, we could use those 
measurements to test the null hypothesis that parameters of the travel time distribution agree with 


(16). Note that the entire travel time plot lies within [fi — 2a,/i + 2cr], so a statistical test of that 
hypothesis would be that the travel time field measurements lie in this range as well. 


Travel Time 



Figure 3: Travel time of 363 vehicles entering link 100053 and departing from link 100036. 


Figure [4] gives the trajectories of all 43 and 47 vehicles that traverse links 100054 and 10008 in 
the westbound direction and links 20008 and 200037 in the eastbound direction. Also shown are 
the red/green durations for the phases at the intersections encountered by these trajectories^] Too 
many vehicles appear to stop at the end of the short link from node 100016 to node 10002 suggesting 
a need to redesign the offset. Direct field observations may validate or reject the signal progression 
quality for this route as indicated by the figure. 

Figure |5] uses the PointQ output for a more detailed analysis of ^(100024,100028). The queue 
grows as vehicles arrive in link 100024 and shrinks as they discharge into link 100028. The flow 

1 There are trajectories that traverse link 103 and stop at node 102 even during green, which seem incorrect, but 
it is because of other vehicles in front that make a turn and do not continue on link 154, so their trajectories are not 
displayed in Figure [4] 
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Figure 4: Trajectories of vehicles that traverse links 100053-10008 and 20008-200037. 


Flows 



Figure 5: Queue #(100024,100028) of the through movement at intersection ID 100025. 
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on a link within (say) a 5s interval is calculated as the number of vehicles that leave this link 
during that interval. The upper part of Figure [5] shows 5s flows leaving links 100023 and 100024. 
From Figure [2] we see that vehicles leaving 100023 enter 100024 and those leaving 100024 enter 
100028. Thus surges in the flow on 100023 lead to surges in q( 100024,100028) and surges in flow 
on 100024 lead to drops in this queue. This is illustrated in the figure by the departure of a 18 
vehicle-platoon from link 100023 followed by a 18-vehicle increase in the size of ^(100024,100028). 
Another observation that corroborates the internal consistency of the simulation model is that the 
vehicle platoons leaving link 100024 are separated by 145s, which is the cycle time of intersection 
100025. Lastly, on-site observation may confirm the simulation prediction that the queues in this 
intersection clear in every cycle. 



Figure 6: Two frames of visualization of vehicle movement. 


As noted earlier, PointQ has a facility to visualize the movement of vehicles like other microsimu¬ 
lation packages. Figure [6] shows two frames of an animation of the movement of all vehicles, each 
represented by a small circle. This helps one understand the formation of queues and the passage of 
vehicles through an intersection in platoons. It also aids in appreciating how congestion propagates 
under heavy demand, see ^8j 


6 Experiments 

Assuming the calibrated baseline model is satisfactory, we use it to conduct four numerical experi¬ 
ments. In Figure [2j entry link 100053 is fed by the off-ramp from I-210W and link 100069 feeds into 
the on-ramp, downstream of the off-ramp. The first two experiments estimate how much additional 
flow can be diverted from I-210W onto the arterial and then returned to the freeway. The objec¬ 
tive is to evaluate the potential of diversion onto the arterial in the event of a capacity-reducing 
incident on the highway. The third experiment compares travel times along the diversion route for 
two fixed-time controls and with max pressure control (Varaiya (2013)). The fourth experiment 
compares a single-commodity and a multiple-commodity model that both give the same link flows. 


6.1 Simple diversion 

We take as baseline traffic the calibrated demands, turn ratios, and flows. We augment this traffic 
with a ‘diversion’ of D vph from the freeway, starting in link 100053, ending in link 100069, and 
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following the direct route through links 

100054,100012, • • • , 100032,100035 (see Figure [§. 

We want to find the largest diversion D that can be accommodated in addition to the baseline 
traffic with the same timing plans. Let Tjj be the set of turn movements 


(100054,100012), (100012,100013), • • • , (100033,100035), (100035,100069) 


followed by the diverted traffic. Let {/*(/, m)} be the turn movements of the baseline traffic 
obtained as the solution of (10)-(14). Then the largest diversion is the extra flow that can be 
accommodated, namely 


D*=maxD (17) 

D 

s.t. /*(Z, m) + D < s(Z, m), (Z, m) G Tp. (18) 


Clearly, 

D* — min{s(Z,m) — /*(Z,m) | (Z,m) G Tp}. 

We find D* = 270 vph. This can be compared with the baseline flow of 522 vph on the off-ramp 
(link 100053). The mean and standard deviation of the travel times of vehicles in the baseline 
traffic that traverse links 100053 and 100036 now is 


/a = 107s and a = 23s, 


(19) 


which, upon comparing with (16), shows that this diversion does not deteriorate the travel of the 
baseline traffic. However, with peak traffic on I-210W of 10,000 vph, the diversion of 270 vph does 
not by itself offer the prospect of significant relief, although it can be an element of a response to 
a delay-causing incident that includes ramp metering and variable message sign alerts. 


6.2 Diversion with re-timing 

We now find the largest diversion D + that can be accommodated in addition to the baseline traffic 
when we are allowed to change the timing plans. This means that in Q t he {g n ,z(Z,m)} are now 
decision variables instead of being specified constants. In place of (17)-(|18|), we have the following 
linear programming problem: 


£>+* 


max D 


s.t. /*(Z, m) + D < s(Z, m), (Z, m) G To, /*(Z, m) < s(Z, m), (Z, m) 0 Tp, 

s(!,m) = y g n ,i(l,m) x c(l,m), for all 
n ies n 

EE E T n L n , for all u, 

i£S n ( l,m ) 

> 0, for all ( l,m),n. 


( 20 ) 

( 21 ) 

( 22 ) 

(23) 

(24) 


The difference between and (|20|-(|24|) is that in the latter the green duration for each 

movement is a decision variable, subject to the constraint that the total green time at intersection 
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n is bounded by the cycle time T n minus the lost time L n . The maximum value in (20) turns out 


to be = 756 vph, almost three times the maximium diversion without retiming of 270 vph. It 
may seem surprising that the mean and standard deviation of the travel times of vehicles in the 
baseline traffic that traverse links 100053 and 100036 now is decreased (compare ©): 

ji — 83.3s and a = 16.7s. (25) 

The improved performance is due to the fact that in this experiment the durations are selected 


optimally according to (20)-(24), so the V/C ratio along this route is decreased with the same cycle 
time. Clearly diversion with optimal re-timing offers more relief to the freeway congestion. 


6.3 Max pressure control 

Max pressure (MP) is a distributed signal control scheme that adjusts the green durations at an 
intersection as a function only of the lengths of the queues immediately upstream and downstream 
of the intersection. An MP control is parametrized by the number of decision times within each 


cycle that the duration can be adjusted. The theory of MP is developed in Varaiya (2013), where it 


is shown that the queue length resulting from MP control is inversely proportional to the number 


of decisions per cycle. Simulation studies of MP are presented in Lioris et al. (2014) and Kouvelas 


et al. (2014). 



FT control with retiming plan 

- MP control 4dec/cyc 

- MP control 8dec/cyc 

i 1 Hi 1 1 ifl ili 




1000 2000 
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Figure 7: Sum of all queues (left) and travel time from off-ramp to on-ramp (right) for the baseline 
traffic, FT vs MP. 


Figure [T] shows the sum of all queue lengths (left) and the travel time (right) from off-ramp (link 
100053) to on-ramp (link 100069) for the baseline traffic with an additional flow of 270 vph diverted 


from the freeway, for five different signal controls: the fixed time (FT) baseline control of £6.1, FT 
control with re-timing of £(12, and MP control with 4, 8, 10 duration decisions per cycle. The plots 
clearly demonstrate the benefits of MP relative to FT control: MP with 10 decisions vs FT has an 
average total queue size of 75 vs 200 vehicles, and off-ramp to on-ramp travel time of 475s vs 650s on 
average, which is a travel time reduction of 27 percent. Since queuing delay is roughly proportional 
to the square of the queue size, MP with 10 decisions has an intersection delay of (75/200) 2 or 14 
percent of FT delay, that is, it achieves a queuing delay reduction of 86 percent compared with the 
baseline. Note that the travel time along the diversion route for the FT control with re-timing is 
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similar to, but the sum of queues is much larger than, that for MP with 10 decisions, which may 
be expected since the re-timing is designed to facilitate movement along the diversion route. 
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Excess Green % 


Figure 8: Histogram of sum of all queues (left) and cumulative probability distribution of ‘excess 
green’ (right) under FT and various MP controls. 


The plots of Figure [8] give a different perspective on the relative performance of FT vs MP control. 
The plot on the left is the histogram (drawn as a continuous curve rather than a bar chart) of 
the sum of all queues under various controls. Thus it is simply the stationary distribution of the 
time series in the left of Figure [7j and shows more clearly the advantage of MP over FT and the 
advantage of more decisions per cycle. The plot on the right uses the notion of ‘excess green’ e(</>) 
of a phase (j) defined as the fraction of time that (j) is actuated but serves no vehicle, i.e. 

time that (j) is actuated and its queue is 0 
time that (j) is actuated 

The cumulative distribution function e i F(e) is plotted on the right: 


^ number of phases </> with e(</>) < e 
total number of phases (j) 

F(e) is a measure of excess capacity for a given intersection control. Thus under FT (MP) 80 (90) 
percent of the phases have an excess green of at least 50 percent, because MP clears queues more 
quickly than FT. 


6.4 Single vs. multiple commodity 


In the experiments of §6.1| and §6.2| vehicles belonging to the baseline flow and those being di¬ 
verted follow routes specified by different turn ratios. So this is a 2-commodity flow. More gen¬ 
erally, a P-commodity flow has P different demands, link flows, turn movements and turn ratios 
{dp /p f p (l , m), r p (Z, m)}, p = 1, • • • , P, each satisfying its own version of the constraints ([6])- (10). 


The aggregate turn movements and link flows are {/(Z,m) = {// = Sp/fl- These 

aggregate quantities define a single commodity flow with (non-unique) turn ratios: 


r(Z, m) — 


Zpf? 


(26) 


Thus as far as link flows are concerned, one can always use a single-commodity flow model. This 
transformation into a single commodity model allows one to use a simple simulation model like 
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CTM as in Lo (2001). But note that using (|26j) requires knowing each of the P commodity flows. 
Moreover the aggregate turn ratios {r(Z,m)} will change if any of the component flows changes, so 
simulating time-varying multi-commodity demands with a single commodity demand is virtually 
impossible. Finally, the routes followed by vehicles in the aggregate single-commodity model bear 
little relation to the routes in the P-commodity model. 


7 Identifiability 

As remarked at the end of j|4] often in practice not enough flows are measured for one to identify 
or impute all link and turn movement flows. We now give conditions on the network graph that 
determine whether or not a particular flow can be calculated from the available measurements. We 
first consider link flows and then extend the results to turn movements. It is assumed that the 
measurements are error-free. 

Let Q — (A/*, C) be a directed graph with nodes J\f and directed links C. It is assumed that Q is 
strongly connected, that is for any two nodes n, m there is a directed path from n to m and another 
directed path from m to n. The graph of Figure [2] is not directly connected, since exit links are 
not connected to entry links. So we add an artificial node, node 0, and have every entry link start 
at 0 and every exit link end at 0. Figure [9] illustrates the procedure. The original network graph 
is shown on the left. It has 5 nodes and 10 links, including 2 exit and 2 entry links. Adding node 
0 (at the bottom) and connecting (by dashed lines) the entry and exit links to 0 gives the strongly 
connected graph in the middle. Suppose the flows in the four red links (6, e, /, g ) in the graph on the 
right are measured and the flows in the remaining six black links are not measured. By Theorem [l] 
below the red measurements together with the flow conservation equation ^ uniquely determine 
all black link flows. 



Figure 9: Original graph (left), adding node 0 (middle), red links are measured (right). 


We will say that a sequence of links (Zi, • • • , Z n , l n +1 = l\) forms an (undirected) cycle if they form 
a cycle in the ordinary sense when we ignore their direction. The sequence forms a directed cycle if 
all links have the same direction. In Figure [9] (6, d, a, b ) and (j, Zi, g , j ) are cycles, whereas (a, /, c, a) 
and (/, c, 6, d, /) are directed cycles. 

Theorem 1 Let Q — (A/", C) be a strongly connected directed graph. Suppose flows on the subset 
A4 of links are measured and flows on the remaining links U — C\M are unmeasured. The flow 
on link e G U can be determined from the measurements on M and the conservation flow equations 
© if and only if e does not belong to a cycle comprised of links from U. 

Proof As in Figure [9] paint the measured links red and the unmeasured links black. Suppose e is 
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a black link that does not belong to any cycle of black links. 

We first prove sufficiency. Suppose link e goes from node i to j. Let B be the set of all nodes 
b except j for which there is an undirected path from i to 6 consisting only of black links. Let 
R — M \ B be the remaining nodes. Every link between B and R except e must be red, that is it 
is measured. Hence the set C of all links that leave or enter B together with link e forms a cutset 
that separates B and R. By flow conservation, the algebraic sum of flows through the cutset must 
be 0 , so 

E + fe = 

lec 

and since the flows in C are measured we obtain f e = — //• I n this equation we abuse notation 

and assign a sign (+ or -) to ft depending on whether link l is pointing into or away from B. 

To prove necessity let L — (Zi, • • • , l n = l±) be a cycle of black links. It is enough to find two 
different sets of flows {//} and iff} such that fl = fffl ^ L and fl ^ ff,l G L. Let {fl} be 
any flow vector with all components strictly larger than some e > 0. Because the graph is strongly 
connected, one can always find such a flow vector. Now select a positive direction for links in the 
cycle L. Construct {ff} by 

{ fl + e, if l E L and the direction of l is postive 

fl — e, if l G L and the direction of l is negative 

fh ^ HL. 

It is easy to see that the conservation equation © is satisfied. Furthermore, fl > 0 for all Z, so 
this is a legitimate flow. □ 

Corollary 1 Suppose Q has l links and n nodes. Then l — (n — 1) is the minimum number of links 
whose flow must be measured in order to determine the flows on all links of Q. 

Proof Every tree of Q has n — 1 links, and each of the non-tree links is part of a unique cycle 
involving only tree links. So every non-tree link must be measured to prevent a cycle comprised 
only of unmeasured links. The number of non-tree links is l — (n — 1). □ 

Q may have many trees, each of which yields a minimal set of link measurements. 

Corollary 2 If there is a directed cycle of unmeasured links the unmeasured flows can be arbitrarily 
large. But if there is no directed cycle of unmeasured links the unmeasured flows can be bounded 
from the measured flows. 

Proof If the cycle L in the proof of Theorem [l] is directed, i.e. all links are either in the positive 
(or negative) direction, then e (—e) can be arbitrarily large. To prove the second assertion, note 
that the subgraph ( TL,U ) of all unmeasured links is a directed acyclic graph, as it has no directed 
cycles. Let ^ be a partial order on TL with h -< h! if there is a directed path from h to h r . Let 
-< h 2 -< • • • -< hx be a total order on TL compatible with the partial order. Partition the links in 
Q that are incident to h\ as UUi with A4i C A4 and Hi C U. By © at node hi 

XI fi + X ^ = 0 ( al § ebraic sum )> 
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which gives the bound 

I//I < I E /iMeWi. 

leMi 

We proceed by induction. Suppose we have bounds on flows on links incident to Zii,--- , hk-i- 
Partition the links incident to as Mk U Uk with Mk consisting of the links that are in M or 
incident to • • • , hk-i- By ^ at node hk 

E /; + E ^ = 0 ( al g ebraic sum )> 

which gives the bound 

\h\ < i E □ 

/G Aik 

7.1 Measuring turn movement flows 

In the preceding section we considered the link flows only and ignored turn movement flows /(Z, m) 
that may be measured or need to be imputed. But this deficiency is easily corrected by adding a 
link (Z,m) for every turn movement we want to consider and take /(Z,m) as the flow on that link. 
This is illustrated in Figure [T0| 



Figure 10: Original node (left), adding turn movements (right). 

On the left in Figure [T0| is a node with four input links and four output links. On the right we add 
four additional links corresponding to the movements (a, 6), (a, c), (a, d ) and (a, e). These links carry 
the flows /(a, 6), /(a, c), /(a, d), /(a, e). So to consider these turn movement flows we can augment 
the graph, and the results above will hold for this augmented graph. Note that the movement (a, e) 
is a U-turn. If this is prohibited, we simply delete this link or regard it as a measured link with 
flow /(a, e) — 0. 


7.2 Known turn ratios 

To consider a measured or unmeasured turn movement flow we add the link (Z, m). Suppose, 

however, that the turn ratio r(Z,m) is measured but the flow /(Z,m) is not measured. How can 
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we use this information? As an example, suppose the turn ratio r(a,/) in Figure 11 is known. 
Suppose further that the link (a, /) is not part of any unmeasured cycle. Then the flow f a can 
be obtained and hence /(a, b) — r(a, 6)/ a can be calculated. In the example of Figure [TT| suppose 
the turn ratios r(a,/) and r(d,/) are known. Then we can obtain f a = [ff — r(cZ, f)fd\/r(a, /)] 
and /(a, e) — f a — r(a, /)/ a . Then there is no cycle with unmeasured links and so all flows can be 
calculated. This argument leads to the following sufficient condition. 


Corollary 3 Suppose link l has known turn ratios r(Z, mi), • • • , r(Z, m&) [JV r(Z, m^) = 1, r(Z, m^) > 
0]. Suppose link (Z,m^) is not part of any cycle of unmeasured links. Then all turn movement flows 
/(Z,mi),--- ,/(Z,m&) can 6e determined. 



Figure 11: Turn ratios for red (black) dashed links are known (unknown). 


7.3 Estimating VMT 

If the unmeasured links (including turn movement links if needed) contain no directed cycle, Corol¬ 
lary [2] implies that flows in the cycles can be bounded. A simple way of computing the inaccuracy 
in the traffic in the unmeasured cycles is to calculate upper and lower bounds on the vehicle miles 
traveled (VMT) on these cycles. This is of independent interest as VMT has become an important 
performance measure^] VMT bounds can also be used to assess the inaccuracy of the calibration 
procedure. If all link flows {//} are measured and the length di of every link is known, 

VMT = Y J difi- 

I 

We want to estimate VMT when not every link flow is measured. As in Theorem [T| suppose 
Q — (TV, C) is strongly connected, flows on A4 C C are measured, and flows in U — C \ A4 are 
unmeasured. Then 

VMT = E dlfl + T^dlfl- ( 27 ) 

The first term on the right can be calculated from measurements, and we estimate the second term. 
Express the flow conservation relations © in matrix form as 

Af = 0, (28) 

2 California Senate Bill 743 states that the criteria for determining the significance of transportation projects may 
include VMT and but not vehicle delay in assessing environmental quality. 
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in which / is the flow column vector with entries //, l G £, A is the node-link incidence matrix with 
entries A(n, Z), n G A/", Z G £: 


A(n, Z) 


+1, if Z G O(n) 
— 1, if Z G /(n) 
0, else. 


Partition / = (/ m , f u ) with entries in Ad and ZY and A. = [A. 71 
= b = 


A u ] so (28) can be written 


(29) 


Then b is known since f m is measured. Suppose f u is of dimension fc, the number of unmeasured 
links. Then f u is uniquely determined by (29) if and only if rank(A w ) = /c, and by Theorem [l] 
rank(A w ) < k if and only if the set of links U contains a cycle. 


Suppose U contains one or more cycles. Then the second term in (27) is not fully determined from 
the measurements, but an upper and lower bound on this term is given as the solution to two linear 
programs: 


VMT™ = max 

; leu 

(30) 

s.t. A u f u = b,f u > 0, 

(31) 

VMT™ = min dif™ 

leu 

(32) 

O 

Al 

-o' 

II 

53 

CC 

(33) 


If VMT m is the first term in ([27]), we can estimate total VMT as 
VMT « VMT m ± ^[VMT™ - VMT™}. 


7.4 Case study continued 


The network of Figure [2] has 16 nodes, 73 links, and 106 turn movements (the other turn movements 
such as U-turns are zero) for a total of 179 flows. The measurements comprise 30 link flows and 57 
turn ratios. Application of the procedures in Theorem [l] and Corollary [3] lead to the identification 
of the flows on 23 unmeasured links. This leaves 73-30-23 = 20 link flows that cannot be identified 
from the measurements. In Figure [12] the measured links are colored red, the unmeasured but 
identifiable links are colored green, the unidentifiable links are colored blue or black. The graph 
comprising these unidentifiable links has 7 nodes (including node 0, not shown), so by Corollary 
[l] an additional (20 - (7-1)) = 14 link flows must be measured to completely identify all network 
flows. We select any tree in this graph, the (7-1) = 6 black links is one such tree; the remaining 14 
blue links must be measured to identify all link flows. Ten of the blue links are exit or entry links 
and 4 are internal links. Figure p~2] summarizes these findings. 


If it is not possible to make these 14 additional measurements, we can use (30)-(33) to bound the 
inaccuracy. We find the maximum and minimum VMT compatible with all the measurements to 
be 


VMT 171 + VMTl = 6824 VMT/hour, VMT 171 + VMT1 = 4998 VMT/hour, (34) 
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Huntington 


Measured links=30 
Unmeasured links=43 



Figure 12: Measured and identifiable links, and 14 links that need to be measured. 


which gives an error bound of ±15%. We simulate the baseline model for 3 hours and record the 
sequence (di,ti) of travel distance and travel time for every vehicle i from the instant it enters the 
network until it leaves the network. 

The simulation gives per hour values of VMT =1/3 d{ — 5, 613 veh-miles, which conforms with 
the bounds in J34| ), VHT = 1/3 = 894 veh-hours, and an estimated average speed of 

v = VMT/VHT = 6.28 mph. 

On the other hand, we can directly calculate the average of all vehicle trip lengths, travel times, 
and experienced speeds as 

1 N i N 1 N 

d = — d{ = 0.6 miles, t = — U = 114.3 s, v = — v>i — 8.95 mph. 

2=1 2=1 2=1 

Here V{ = di/U and N = 28,153 is the total number of trips that traverse at least one internal link 
(trips that start at an entry link and immediately exit are omitted). Since we find v < v, this must 
imply that 

'EUVi ^E v i 
Eu N ’ 

and this inequality suggests that {vi} and {±} are negatively correlated: longer-duration trips are 
made at slower speeds, and indeed calculation gives the correlation p(^,±) = —0.15. 


8 A macroscopic queuing model 


In the left of Figure[l3| the are external arrivals into the entry links, the {akit)} are internal 

arrivals into the network upon leaving the entry link queues, the {d&(£)} are departures from the 
network, the {wk(t)} are the numbers of vehicles queued in the entry links, and the {rik(t)} are 
the numbers of vehicles in the internal links, either queued or traveling. The aggregate quantities 
e(£), a(£), d(t),w(t),n(t) are processes of the macroscopic queuing system shown in the right of the 
Figure p~3{ The behavior of the macroscopic queue depends on two factors - the pattern of demand 
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e(t) = J2 e k(t) 
a(t) = J2 a k(t) 
d{t) = J2 d k(t) 
n(t) = 'EM*) 

w(t ) = T,Wk(t) 


Figure 13: Macroscopic queuing model of arterial network, with aggregate quantities e,a,d, w,n. 


(volumes, turn ratios) and the intersection signal controllers - as will be seen in the analysis of two 
experiments. 

In the first experiment we load the network with the baseline arrivals (e&(£)}, with turn ratios also 
given by the baseline model. The total external arrival rate is A = ^ e&(£) = 14, 335 vph. With this 
loading the network is stable, so the internal arrival and departure rates also equal A. If E is the 
average time spent in the entry links, T is the average sojourn or trip time inside the network, and 
w, n are the average number of vehicles waiting in the entry links and inside the network, Little’s 
formula gives 

w + n = (E + T)\; w = EX; n — TX . (35) 

Figure [T4]( a) plots the cumulative external arrivals (green), internal arrivals (blue) and departures 
(red) during the time interval [5700,6100]s. The slope of all three curves is A = 14,335 vph. The 
horizontal (vertical) distance between the green and red curves is E+T = 98s (w+n = 358 vehicles); 
and the horizontal (vertical) distance between the blue and red curves is T — 68 s (n — 270 vehicles), 
in accordance with ( [35]) . We also consider the behavior of the network under max pressure (MP) 
control. From Figure]l4| (b) we see that the average value of n(t) for FT is considerably larger than 
for MP, as expected. However, since the network is stable (w(t) and n{t) remain bounded) under 
both controls, arrivals into and departures from the network are virtually the same. 

In the second experiment, we increase the network loading proportionately in 2-hour steps as 
{ 7 e/e(t)}, with 7 =1, 1.05, 1.15, 1.3, 1.5, 1.7, 2, 2.2, 2.5. Because 2 hours is much longer than 
the longest travel times (see Figure [7]), the network will reach a ‘steady state’ if it is stable. From 
Figure ?? we can see that under FT, the network is stable for 7 = 1.05 (t = 2h), whereas under 
MP, it is stable for 7 = 1.7 (t — 12h). For 7 = 1.05 (t — 2h), the network is stable under both FT 
and MP controls, and the macroscopic queues are similar, like in Figure [l4](b) . 

However for 7 > 1.05, the FT controlled network becomes unstable, some internal links become 
saturated, causing spill back and blocking of upstream links. Eventually vehicles queue up at the 
entry links, the internal arrival rate drops below the external arrival rate (at t = 2 h), and the 
number of vehicles inside the network increases as it gets congested. This is seen in Figure ??(c). 

The MP-controlled network becomes unstable for 7 > 1.7 (t — 12 h): internal queues become 
saturated, vehicles queue up at the entry links and the departure rate drops (Fig ??(b),(c)). 

Figure ?? suggests that we may define the network capacity as the maximum value of 7 x 14, 335 
for which the network is stable, which turns out to be 15,051 vph (7 = 1.05) for FT and 24,369 
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(a) (b) 

Figure 14: (a) Cumulative external arrivals (green), internal arrivals (blue) and departures (red) 
for FT control and 7 = 1, (b) number of vehicles, w(t) and n(t) for FT control and MP control. 


vph (7 = 1.7) for MP. Thus network capacity depends on the intersection control. It also depends 
on the pattern of demand]^] 

Once the external arrival rate exceeds capacity, the network queue n(t) rises very sharply, as 
seen in Figure ??(c). This rapid increase resembles a ‘phase transition’. Detailed analysis of the 
simulations suggests the following pattern. When network loading exceeds capacity, some internal 
links get saturated, blocking upstream links. Congestion spreads and in a short time a significant 
portion of the network links becomes saturated, causing a sharp increase in the number of vehicles 
in the network. We might say that as external demand exceeds network capacity, the network 
rapidly enters ‘gridlock’. 

In summary, the behavior of the macroscopic queue model (MQM) can be characterized in terms of 
network capacity: if the external demand is below capacity, the network is stable, queues remains 
bounded and the rate of arrivals (demand) equals the rate of departures. When demand exceeds 
the network capacity, the network becomes saturated, and the rate of departures drops below the 
demand. Thus if we were to plot aggregate rate of departures (d) as a function of the aggregate 
rate of external arrivals e, d = /(e), the graph of / will have slope of 1 until e reaches capacity, 
after which the slope drops below 1 and vehicles begin to accumulate in the network. Moreover, 
the number of vehicles in the network will be relatively constant until demand reaches capacity 
after which it grows rapidly. This suggests the stylized macroscopic queuing diagram (MQD) of 
Figure [15] 


8.1 Comparison with macroscopic fundamental diagram (MFD) 


It seems appropriate to compare the macroscopic queue model (MQM) and the macroscopic fun¬ 
damental diagram (MFD) of Geroliminis and Daganzo (2008]). MFD is an empirical device that 
captures the relationship between the aggregate flow and density within a network, using measure¬ 
ments of flow fi(t) and occupancy Oi(t) for a sample of links i. The aggregate flow and density are 


3 Although not shown here, a demand pattern different from the baseline, leads to different network capacity. 
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net capacity net capacity 
(FT) (MP) 


-> 

demand (7) 


Figure 15: Macroscopic queuing diagram (MQD) of arterial network under FT and MP control: 
departure rate (left) and number of vehicles in the network (right) as demand 7 is increased. 


constructed as 

_E ikfi{t) 

Ed* ’ Ed* 



(36) 


in which is the length of link i multiplied by the number of lanes. The scatter plot of pairs 
(/(£), o(£)), t — 1, • • • , T has a parabolic shape, similar to what one gets for a single link. This plot 
is called the macroscopic fundamental diagram (MFD). 


MFD and MQM are related. MFD’s aggregate occupancy measure is related to the number of 
vehicles in MQM: indeed occupancy as measured by detectors is a proxy for spatial density, which 
is simply number of vehicles in a link divided by its length. MFD’s flow measure is related to the 
aggregate departure rate of MQM, for as Geroliminis and Daganzo (2008) argue there is a ‘linear 
relation’ between departure rate and network flow. The notion of network capacity in both MFD 
and MQM are similar: MFD defines it as the maximum network flow, and MQM defines it as 
maximum departure rate. 


One difference between MFD and MQM is that the latter makes explicit its dependence on both 
the pattern of demand and signal control. This dependence is only implicit in MFD: for example, 
MFD for different time periods of the day will be different since the pattern of traffic is different. 
Another difference concerns network behavior when demand exceeds capacity. Since MFD is an 
equilibrium notion, it cannot describe the phase transition that accompanies instability caused 
by excess demand, whereas MQM is a dynamic model that does portray what happens in excess 
demand conditions. 


Lastly, both MFD and MQM suggest the value of ‘perimeter control’ to prevent congestion inside 
the network (Geroliminis et al. (2013)). Indeed it is clear from Figures ?? and 15 that if external 
arrivals are restricted so that they do not exceed capacity, the network will not get congested. 
As Figure ??(b) suggests, appropriate perimeter control will lead to an accumulation of vehicles 
at entry links in case of excess demand while protecting the internal network from congestion. 
Implementing a perimeter control requires having a signal that indicates when network capacity is 
approached. It seems difficult to directly measure the aggregate arrival rate since an urban network 
will have many entry links. If the number of vehicles, n(t), inside the network could be measured, 
a rapid increase in n{t) would provide such a signal as seen in Figure ??(c). However, measuring 
n{t) seems impracticable. One proxy measure is the travel time T experienced by vehicles going 
through the network, for according to (35) T is proportional to the aggregate arrival rate. 


22 





















9 Conclusion 


Microsimulation studies of arterial networks must compromise between adopting a model that is 
rich in behavioral detail and working with field measurements that are incomplete and sometimes 
inconsistent. Using a behaviorally rich model may entail abandoning rigorous calibration or valida¬ 
tion. This paper proposes an alternative approach based on the PointQ simulation model. PointQ 
is a mesoscopic-microscopic model: it maintains the identity of individual vehicles, but ignores 
inter-vehicle interaction due to driver car-following behavior. PointQ’s advantage is that it is easy 
to calibrate using commonly available field data. The approach uses conservation of flow identities 
to impute unmeasured flows, and it provides bounds in terms of a VMT gap on the inaccuracy due 
to flows that cannot be imputed and gives minimal sets of additional flow measurements to impute 
all flows. Most of the effort in using PointQ is devoted to evaluating performance (such as travel 
times and intersection performance) that can be compared with other field measurements or with 
the intuition that engineers operating the network have. The rest of the effort is devoted to using 
the calibrated PointQ model to conduct experiments for which the model is constructed. 

The approach is illustrated by a small arterial network adjacent to the 1-210 freeway in Los Angeles. 
The network has 16 intersections, 73 links and 106 turn movements, for a total of 179 flows Q The 
measurements comprise flows on only 30 links and 57 turn ratios. The calibration and imputation 
procedure identifies all except 22 flows and determines that 14 additional measurements are needed 
to identify all flows. Without these measurements there is an error bound of ±15% on VMT that 
is accounted by the model. Several experiments are conducted. Two of these determine how much 
additional freeway traffic can be diverted on to the arterial network with or without a change in 
timing plans. The third experiment estimates the savings in intersection delay, travel time, and 
network capacity obtained by replacing the fixed time controllers by max pressure controllers. The 
fourth experiment demonstrates that it is a poor idea to model traffic as a single-commodity flow 
when you know that the traffic follows two different routing disciplines. 

A macroscopic queuing model (MQM) is proposed to relate aggregates of external, internal and 
departure flows, together with the total number of vehicles in the network. MQM is compared 
with the macroscopic fundamental diagram (MFD). Both MQM and MFD lead to the notion of 
network capacity which, in turn, is useful in constructing a perimeter control to prevent network 
congestion. 


Appendix 


The following table show the calibration results obtained by solving (10)-(14). 


4 The network studied here is part of a network with 450 intersection, so it is 30 times larger, 
algorithms and the PointQ simulator itself are expected to scale linearly to the larger network. 


The calibration 


23 






Link ids, / 

Link ids, m 

Measured turn 
ratios, r(l,m) 

Calculated turn 
ratios, r(/,m) 

Link ids, / 

Measured flows, 
V (vph) 

Calculated flows, 

ft, W) 

100037 

100054 

0.65 

0.652 

200054 

1016 

1014 

100037 

200053 

0.35 

0.348 

10002 

-1 

954 

100053 

100054 

0.74 

0.743 

20003 

814 

817 

100053 

200037 

0.26 

0.257 

10003 

-1 

993 

200054 

200037 

0.9 


20008 

-1 

1053 

200054 

200053 

0.1 


10008 

-1 

1644 

10005 

10003 

0.17 

0.166 

200011 

-1 

1052 

10005 

200054 

0.83 

0.834 

100011 

940 

943 

10002 

10003 

1 


200014 

1270 

1270 

100057 

200054 

-1 


100014 

766 

762 

20003 

200054 

1 


200017 

-1 

916 

10003 

10004 

-1 

0.526 

100017 

708 

708 

10003 

10008 

-1 

0.474 

200020 

1035 

1037 

100038 

10008 

-1 

0.576 

100020 

792 

805 

100038 

100040 

-1 

0.424 

200021 

736 

736 

100039 

10004 

-1 

0.637 

100021 

1193 

1179 

100039 

20003 

-1 

0.363 

200023 

803 

801 

20008 

100040 

-1 

0.715 

100028 

-1 

644 

20008 

20003 

-1 

0.285 

200032 

-1 

1288 

10008 

100011 

-1 

0.223 

100032 

-1 

542 

10008 

100036 

-1 

0.777 

200033 

-1 

1266 

100042 

100011 

-1 


100035 

-1 

789 

200011 

20008 

-1 


100054 

1065 

1060 

100011 

100014 

0.75 

0.752 

100023 

477 

477 

100011 

100043 

0.19 

0.189 

100024 

-1 

448 

100011 

100060 

0.06 

0.059 

200028 

1087 

1087 

100044 

100014 

0.08 

0.090 

100033 

517 

517 

100044 

100043 

0.73 

0.725 

100022 

-1 

767 

100044 

200011 

0.19 

0.185 

100025 

-1 

29 

100061 

100014 

0.08 

0.086 

200037 

-1 

1046 

100061 

100060 

0.51 

0.507 

200027 

-1 

300 

100061 

200011 

0.41 

0.407 

10004 

-1 

1428 

200014 

100043 

-1 

0.293 

100040 

-1 

1616 

200014 

100060 

0.03 

0.030 

100041 

0 

0 

200014 

200011 

-1 

0.677 

100043 

-1 

712 

100014 

100017 

-1 

0.229 

100045 

-1 

882 

100014 

100045 

-1 

0.124 

100047 

-1 

882 

100014 

100062 

-1 

0.647 

100050 

-1 

271 

100046 

100017 

-1 

0.668 

100051 

-1 

719 

100046 

100045 

-1 

0.332 

100052 

-1 

577 

100063 

100062 

-1 

0.209 

200053 

-1 

461 

100063 

200014 

-1 

0.791 

100056 

-1 

106 

200017 

100045 

-1 

0.571 

100058 

0 

0 

200017 

100062 

-1 

0.105 

100036 

-1 

1278 

200017 

200014 

-1 

0.325 

100060 

-1 

281 

100017 

100020 

0.73 

0.730 

100062 

-1 

846 

100017 

100047 

0.17 

0.170 

100065 

-1 

226 

100017 

100065 

0.1 

0.100 

100069 

-1 

245 

100048 

100020 

0.11 

0.110 

100073 

-1 

461 

100048 

100047 

0.72 

0.720 

100072 

-1 

663 

100048 

200017 

0.17 

0.170 

100075 

-1 

545 

100064 

100020 

-1 

0.517 

10005 

230 

232 

100064 

100065 

-1 

0.249 

100027 

210 

210 

100064 

200017 

-1 

0.234 

100037 

1030 

1033 

200020 

100047 

0.27 

0.270 

100038 

-1 

2037 

200020 

100065 
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